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Quantifying  Flexibility  in  Sequential  Decision  Making: 
Helping  Commanders  Assess  Flexibility  in  Planning 

January  1, 2003  -  January  1,  2006 

Caroline  Hayes  and  Saif  Benjaafar 


Objectives: 

•  Formalize  the  notion  of  flexibility, 

•  Provide  a  framework  for  its  modeling,  measurement  and  evaluation, 

•  Study  the  relationship  between  flexibility  and  value, 

•  Explore  application  of  these  concepts  in  the  task  of  selection  of  a  course  of  action. 


Planned  outcomes: 

•  A  definition  of  flexibility  and  its  measurement, 

•  An  understanding  of  relationships  between  flexibility  and  value, 

•  A  decision  criterion  for  capturing  flexibility, 

•  A  basis  for  designing  software  tools  to  assist  commanders  in  assessing  the  flexibility  of 
action  choices,  and  the  value  of  flexibility  in  light  of  the  current  situation. 

• 


In  this  work,  we  have  explored  the  joint  issues  of  1)  how  to  characterize  flexibility  for  use  in 
quantifying  the  value  of  decision  alternatives,  and  2)  whether  decision  making  methodologies 
incorporating  parameters  relevant  to  flexibility  can  be  applied  effectively  in  practical  decision¬ 
making  contexts.  We  have  studied  these  issues  in  the  context  of  complex  multi-criteria  planning 
tasks  including  military  course  of  action  planning,  asset  allocation  and  aviation  scheduling. 

Battle,  whether  open  warfare  or  terrorist  insurgency,  can  be  characterized  by  rapid  and 
unexpected  changes,  and  much  uncertain  or  unknown  information  (also  known  as  the  fog  of  war). 
Consequently,  flexibility  is  a  very  important  property  in  the  courses  of  action  (COAs)  employed 
in  meeting  military  and  political  objectives.  Flexibility  is  especially  valuable  in  highly  uncertain 
situations  in  which  the  ability  to  react  to  unforeseen  events  may  be  more  critical  than  the  ability 
to  identify  the  most  effective  plan  for  any  given  situation.  In  a  battle  situation,  flexibility  allows 
you  to  compensate  for  the  fact  that  you  do  not  know  exactly  what  the  enemy  will  do;  flexibility 
allows  you  to  succeed  despite  the  unknown. 
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Unfortunately,  even  skilled  COA  planners  have  difficulty  assessing  the  relative  flexibility  of 
alternative  COAs,  and  relevant  mathematical  measures  of  flexibility  which  they  might  use  to 
assist  them  in  these  judgments  have  not  been  developed.  The  goals  of  this  work  are  to  study 
flexibility  and  its  value  in  situations  where  knowledge  is  inexact,  incomplete  and  the  situation  is 
rapidly  changing,  and  to  assess  whether  these  methods  can  be  translated  into  practical  decision 
making  contexts. 

Personnel  supported  in  full  or  part  by  this  grant  include  faculty  members  Caroline  Hayes  and 
Saif  Benjaafar;  and  graduate  students  Maher  Lahmar  (PhD),  Dileepan  Narayanan  (masters), 
Yimin  Yu  (PhD,  still  in  progress),  Setareh  Mardan  (PhD),  and  Lakshmi  Venkatesan  (masters)  and 
The  results  of  this  work  are  reported  in  5  theses  [1-5]  and  1 2  refereed  articles  [12,  15  —  18,  21  - 
27]  (see  full  references  below  under  the  headings  “Masters  and  PhD  Theses”  and  “Publications”). 
These  publications  can  be  obtained  either  through  the  journal  or  conference  proceedings  in  which 
these  articles  have  appeared,  or  by  sending  a  request  to  the  relevant  authors. 

Approach.  This  work  was  carried  out  using  a  combination  of  theoretical  and  empirical 
approaches.  We  used  a  theoretical  approach  to  develop  the  basic  concepts  of  flexibility,  and 
empirical  approaches  including  simulation,  and  empirical  testing  with  human  subjects  to 
determine  the  practical  impact  of  the  concepts  and  models  developed  in  this  work. 

In  this  work  we  explored: 

■  A  framework  for  thinking  about  plan  flexibility  in  adversarial  situations, 

■  An  experiment  assessing  how  decision  support  tools  that  help  explore  flexibility  impact 
human  plan  quality 

■  Flexible  asset  configurations  that  maximize  performance  while  minimizing  training  and 
procurement  costs. 

Flexibilty  Framework.  There  are  many  ways  in  which  one  might  define  flexibility.  To 
define  flexibility  in  the  context  of  a  plan,  it  is  first  necessary  to  establish  a  definition  for  a  plan. 

In  this  work,  a  plan  is:  A  commitment  of  assets  to  tasks  or  roles  which  forward  mission 
objectives.  Thus,  a  COA  fits  this  definition  of  a  plan  when  it  is  specified  as  a  configuration  of 
assets  (units  and  equipment)  at  starting  positions  in  the  battlespace.  Each  unit  is  typically  given  a 
specific  role  or  mission  which  is  intended  to  carry  out  some  aspect  of  the  commander’s  intent. 
Flexibility  in  a  plan  can  be  defined  in  several  ways: 

1 .  Alternate  future  sequences  for  tasks 

2.  Alternate  future  assignments  of  assets  to  tasks. 

We  have  adopted  definition  2.  for  the  purposes  of  this  work. 

Flexibility  in  a  Plan  is: 


■  Alternate  future 
sequences  for 
tasks 


■  Alternate  future 
assignments  of 
assets  to  tasks. 


Major  findings. 

The  value  of  flexibility: 

1.  Flexibility  results  in  superior  average  performance.  Introducing  some  flexibility  can 
have  a  significant  impact  on  performance;  two  or  three  options  leads  to  much  better 
performance  than  only  one.  This  particularly  true  in  highly  variable  or  environments  or 
environment  where  assets  are  subject  to  high  workload  (such  as  battle  situations). 

2.  Lots  of  flexibility  in  not  significantly  better  than  a  little  flexibility.  The  impact  of 
flexibility  on  performance  exhibits  strong  diminishing  returns,  with  most  of  the  benefit 
realized  with  relatively  limited  flexibility.  In  other  terms,  large  numbers  of  options  do 
not  necessarily  offer  much  advantage  over  a  few  good  options. 

3.  There  are  specific  ways  of  offering  flexibility  that  are  more  advantageous  than 
others.  A  “chaining”  configuration  of  flexibility  can  be  nearly  as  effective  as  a  full 
flexibility  configuration.  A  chaining  configuration  is  shown  in  the  Figure,  below.  In  a 
chained  configuration,  each  asset  should  be  capable  of  performing/being  used  for  at  least 
two  types  of  tasks  as  shown.  Such  a  configuration  provides  high  performance  and 
relatively  low  cost. 


(a)  Specialization:  each  (a)  Full  flexibility:  Any  asset  (a)  Chained  flexibility:  each  asset 
asset  type  is  dedicated  to  can  carry  out  any  task  has  one  overlapping  capability 

one  task  type  with  each  neighboring  asset 

The  impact  of  flexibility  on  decision  making: 

4.  The  performance  of  intermediate-level  COA  planners  (1-5  years  experience)  was 
significantly  improved  when  they  used  a  computer  decision  support  tool  to  help  them 
consider  a  wider  range  (i.e.  more  flexible)  of  options.  However,  the  performance  of 
expert-level  COA  planners  (6  plus  years  of  experience)  was  not  significantly  improved 
when  they  used  the  same  tool. 

5.  Subjects  produced  significantly  better  Effects-Based  Operations  Plans  when  they 
were  given  both  plan  quality  assessments,  and  information  about  remaining 
resources  (allowing  them  to  assess  flexibility  in  terms  of  unallocated  assets  remaining) 

Discussion 

The  findings  above  tell  us  several  things  about  current  practice  in  military  planning  and  asset 
assignment,  and  about  what  future  practice  should  be.  Finding  1  above  confirms  the 
appropriateness  of  the  existing  practice  of  exploring  several  appropriate  courses  of  action  for  any 
given  situation.  It  is  always  recommended  the  planners  find  several  COA;  in  practice,  they  often 
explore  between  1  and  3  options,  often  not  more.  Finding  2  might  suggests  that  exploring  more 
that  3  options  (more  flexibility)  is  not  necessarily  better  than  exploring  just  a  few  options.  Thus, 
while  commanders  frequently  express  concerns  that  the  2  to  3  options  that  their  subordinates  tend 


to  produce  may  not  be  enough,  the  Finding  2  suggests  that  perhaps  there  may  not  be  such  a  great 
advantage/pay-off  in  taking  the  time  to  explore  many  COA  options  in  depth. 

Findings  1  and  2  provide  some  explanations  and  insights  into  Finding  4.  There  are  two 
observations  in  Finding  4.  First,  that  experts  are  not  greatly  helped  by  having  more  options 
generated  for  them.  This  is  consistent  with  Finding  2.  In  fact,  Finding  2,  that  more  options  does 
not  offer  significant  benefits  over  a  few  (2  to  3)  options,  may  explain  why  expert  performance  is 
not  significantly  improved  when  they  are  shown  more  COA  options.  However,  the  second 
observation,  that  intermediate-level  planners’  performance  was  improved  by  being  shown  more 
options,  appears  to  contradict  Finding  2.  An  examination  of  nature  of  the  options  generated  by 
the  intermediates  provides  some  insights  into  what  is  happening.  The  options  generated  by  the 
intermediates  were  not  always  very  good  ones,  and  some  violated  the  rules  for  proper  formation 
of  CO  As.  This  may  indicate  that  if  one  is  going  to  explore  only  a  few  options,  they  need  to  be 
high  quality  options.  Thus,  finding  2  may  not  hold  if  the  options  are  not  of  sufficient  quality,  or 
are  not  sufficiently  distinct  from  each  other.  Finding  4  may  also  indicate  that  intermediate  COA 
planners  are  often  capable  of  recognizing  a  high  quality  COA,  even  if  they  can’t  always  generate 
many  good  ones. 

Finding  3,  on  chained  asset  configurations,  suggests  that  by  teaching  planners  to 
recognize  and  use  this  type  of  asset  assignment,  they  may  be  able  to  reduce  training  and 
equipment  costs,  while  maintaining  high  flexibility  and  performance  in  battle. 

Finding  5,  suggests  what  types  of  information  that  decision  makers  need  to  have  available, 
at  a  minimum  in  order  to  assess  the  flexibility  of  a  given  choice.  Even  if  the  decision  makers 
could  have  derived  this  information  by  hand,  in  practice  they  did  not.  Having  it  made  available 
by  a  computer  tool  was  beneficial  to  them. 

Conclusions 

We  have  confirmed  both  theoretically  and  empirically  that  flexibility  in  asset  allocation  does 
lead  to  better  performance,  but  that  a  little  flexibility  (2  to  3  options)  provides  almost  the  same 
benefits  at  much  lower  cost  than  much  greater  flexibility.  Furthermore,  that  certain 
configurations  of  assets,  in  particular  chained  flexibility,  offers  high  performance  at  less  cost  than 
many  other  configurations.  Lastly,  decision  support  tools  can  offer  benefits  to  intermediate  level 
planners  and  improve  their  performance  in  generating  plans  by  helping  them  to  identify  higher 
quality  options,  and  by  providing  appropriate  information  to  help  them  assess  the  flexibility  of 
different  plan  options. 
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